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(54) Information storage system 



(57) By assuring and maintaining consistency of da- 
ta within a range expected by the user, significance of 
the consistency of data is assured. 

A master control unit 105 to which write data and its 
write time is transferred from an information processor 
100 is provided with a function of obtaining the latest 
write time and the oldest write time of write data which 



has not been copied to each of remote control units 115 
as a copy destination at proper timings and comparing 
the difference between the latest and oldest write time 
with a preset time on the basis of a data consistency unit 
such as a data set. When the difference reaches or ex- 
ceeds the preset time, data within the data consistency 
assuring range is suspended or write data and copy data 
is regulated. 
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Description 

BACKGROUND OF THE INVENTION 

[0001 ] The present invention relates to an information 
storage system having the function of copying or com- 
pressing and storing updated data as secondary data 
among one or more control units. 
[0002] International application published under the 
patent cooperation treaty WO 94/2591 9 relates to dupli- 
cation of data which is sent/received among control 
units existing in remote places and discloses an asyn- 
chronous data duplication technique which does not ex- 
ert an influence on the write response by storing primary 
data sent from the host to a primary data control unit, 
after that, sending secondary data as a copy of the pri- 
mary data from the primary data control unit to a sec- 
ondary data control unit as a copy destination in a posi- 
tion which is geometrically and physically remote from 
the primary data control unit. 

SUMMARY OF THE INVENTION 

[0003] According to the International application pub- 
lished under the patent cooperation treaty WO 
94/25919, the primary data control unit is provided with 
a primary data information system, the secondary data 
control unit is provided with a secondary data informa- 
tion system, and an asynchronous copying process 
from the primary data control unit to the secondary data 
control unit is performed. It is not, however, described 
that the primary and secondary data information sys- 
tems assure consistency of data in the asynchronous 
data duplication. 

[0004] it is therefore an object of the invention to pro- 
vide a function of assuring not only consistency of data 
but also the limit of the assurance from various points 
of view, and to assure significance of the consistency of 
data by assuring and maintaining the data consistency . 
within the range expected by the user. 
[0005] In order to solve the problems, according to the 
invention, there is provided an information storage sys- 
tem comprising: one or more master control units each 
having a memory and one or more storing units, for re- 
ceiving a data write request from an information proc- 
essor and storing the write data; and one or more remote 
control units each having a memory and one or more 
storing units, to which the write data is transferred from 
the master control unit and which stores the write data, 
wherein any of the control units includes a control mod- 
ule for comparing a time difference between the latest 
time and the oldest time among added write time in a 
group of write data which has not been transferred but 
should be transferred to the remote control unit with a 
preset allowance time. 

[0006] When the time difference exceeds the allow- 
ance time, the control module may regulate a write re- 
quest from the information processor, or regulate or in- 



terrupt writing of data to the remote control unit as a des- 
tination of write data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 

[0007] Fig. 1 shows an example of the configuration 
of an information storage system according to the inven- 
tion. 

[0008] Fig. 2 is a schematic diagram of logical devices 
10 defined by a plurality of physical devices as in a RAID 
structure. 

[0009] Fig. 3 is a diagram specifically showing control 
information written in a control memory. 
[0010] Fig. 4 shows a processing flow in a first em- 
15 bodiment. 

[001 1 ] Fig. 5 shows a processing flow in a second em- 
bodiment. 

[0012] Fig. 6 shows another processing flow in the 
second embodiment. 
20 [0013] Fig. 7 shows a processing flow in a third em- 
bodiment. 

DETAILED DESCRIPTION OF THE INVENTION 

2$ [0014] Embodiments of the invention will be de- 
scribed hereinbelow. 

[0015] A first embodiment will be described first. 
[0016] Fig. 1 is a diagram schematically showing an 
information storage system according to the first em- 

30 bodiment. The information storage system comprises: 
one or more information processors 100; one master 
control unit 105; one or more magnetic disk units 110 
serving as information storing units connected to the 
master control unit 105; a remote control unit 115 con- 

35 nected to the master control unit 105 via a data path 
1 09; and one or more magnetic disk units 1 1 0 connected 
to the remote control unit 115. In the specification, the 
invention is not limited to the system in which the master 
and remote control units and the information processor 

40 are connected but can be also applied to an information 
system in which the master or remote control unit and 
the information processor are connected. 
[0017] Although the processor 100 comprises a CPU 
101, a main storage 102, and channels 103 in the em- 

45 bodiment, other configurations may be also used. For 
example, another apparatus (such as SVP) can have a 
part of the functions of the CPU and execute it. 
[0018] The master control unit 105 has a cache mem- 
ory 106 and a control memory 107 which can be ac- 

so cessed at high speed, receives a data write request from 
the information processor 1 00, and reflects data into the 
magnetic disk unit 110. 

[0019] In order to assure high reliability, a non-volatile 
memory is mounted in each of the memories 1 06 and 
55 107. Further, data may be duplicated in the memories 
106 and 107. 

[0020] The master control unit 105 sets and defines 
various information via the information processor. In the 
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master control unit 105, a service processor (SVP) 108 
capable of easily setting and defining the various infor- 
mation without using the information processor can be 
mounted. 

[0021] Further, with respect to the disk units 110, there s 
can be a case of adopting a RAID structure for defining 
one or more logical disks 201 by the plurality of disk units 
110 as shown in Fig. 2. 

[0022] In place of the magnetic disk units 110, an in- 
formation storage using other storage medium such as to 
magnetic tape, optical disk, or semiconductor memory 
may be connected. 

[0023] The remote control unit 11 5 has the configura- 
tion similar to that of the master control unit 105. 
[0024] The information processor 1 00 sends the data 1$ 
write request to the master control unit 1 05 and transfers 
write data 120. 

[0025] Each data write request includes its issuance . 
time, that is, timestamp 121 and the data write request : 
and the timestamp 121 are transferred to the master 1 20 
control unit 1 05. The timestamp may not be added to 
the data write request. 

[0026] When a plurality of information processors 1 00 
exist, the timestamp 121 is synchronized by using a 
common clock. The information processors 1 00 can rec- 25 
ognize the timestamp of each other. 
[0027] When the timestamp 121 is not added on the 
information processor 100 side, for example, the master 
control unit 105 side which receives the write request 
may add time upon receipt of the write request in place 30 
of the timestamp. 

[0028] The (magnetic disk unit 1 1 0 of the) remote con- 
trol unit 115 corresponds to a backup of the write data 
120 which is received by the master control unit 105 
from the information processor 1 00. The master control 35 
unit 1 05 transfers the write data 1 20 as it is as copy data 
or by compressing it to the remote control unit 115. 
[0029] Fig. 3 shows specific data in the control mem- 
ory 107 in the master control unit 105. 
[0030] A write data control block 300 includes a write *o 
address (logical address) 301 and a write address 
(physical address) 302 to the disk unit 110 to be con- 
nected to the master control unit of each data, an ad- 
dress 303 on the cache memory, data length 304, se- 
quential number 305 which is serially allocated in ac- 45 
cordance with the order of acceptance of the write re- 
quest, timestamp 306, and a copy pending information 
flag 307 set to write data which has to be copied to the 
remote control unit 115, that is, which has not been 
transferred yet. so 
[0031] The copy pending information flag is included 
in the write data control information of the master control 
unit and a non-reflected data flag is included in the write 
data control information of the remote control unit. 
[0032] A consistency time group control block 31 0 in- ss 
eludes consistency time group information 320 and con- 
sistency time detail information 330. There is/are one or 
more groups of write data on the copying side (master 



control unit 105 side) and write data on the copied side 
(remote control unit 115 side), for example, one or more 
groups of logical disks (or logical devices) 201 . The con- 
sistency time group information 320 includes informa- 
tion indicating that one or more groups 321 (one is a unit 
for assuring the data consistency) is/are registered or 
not and the present status of each group. The consist- 
ency time group detail information 330 comprises infor- 
mation of each pair belonging to the group 334 (specif- 
ically, master volume number 331, information 332 of 
the other side such as ID of the remote control unit and 
the logical device number, a group status 333 indicative 
of the present status of the group, and the like) and var- 
ious parameters of the control group such as the oldest 
timestamp 336 of uncopied data belonging to the control 
group, the latest timestamp 337, copy pending allow- 
ance time 335 which is set and stored to suspend the 
copying process from a copying side to a copied side of 
the control group when a certain time has elapsed or to 
regulate data transfer from an upper apparatus to the 
copying side, and consistency time 338 in which the 
present data consistency of the control group is as- 
sured. 

[0033] Data has to be copied in order from the master 
control unit to the remote control unit. The consistency 
of data denotes that the order of the data is kept. The 
consistency time denotes a timestamp of data which is 
copied last in accordance with the order and has already 
been copied. The data copied until the time is assured 
to be consistent. 

[0034] In the embodiment, accurate data consistency 
time is held by the remote control unit 115 as a times- 
tamp of data which is copied last in accordance with the 
order and has been copied. The master control unit 105 
therefore obtains the latest consistency time from the 
remote control unit 115 and stores it into the area 338. 
[0035] There is a case that information included in the 
control memory 107 is stored on the cache memory. 
[0036] The remote control unit 1 1 5 also has a similar 
control memory 107. In the unit 115, the write data con- 
trol block 300 is allocated for control information of each 
copy data in the remote control unit 115, and the con- 
sistency time group control block 310 is allocated for in- 
formation regarding all of pairs for copying data to the 
remote control unit 1 1 5 and the group to which the pairs 
belong. 

[0037] Particularly, in order to display copy data hav- 
ing timestamp later than the data consistency time 
(hereinlater, called non-reflected data whose consisten- 
cy is not yet assured) as write data control information 
on the remote control 115 side, the non-reflected data 
display flag is provided in the embodiment. The flag may 
not be provided. 

[0038] The non-reflected data denotes data which 
should not be reflected as formal data in the disk unit 
110 as a target to be written. 

[0039] Fig. 4 schematically shows a flow of the first 
embodiment. 
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[0040] Control group option parameters including the 
control group and the copy pending time 335 are set by 
the information processor 1 00 or service processor 1 08. 
The set parameters are transferred to the master control 
unit 105 and registered into the consistency time group 
control block 310 in the control memory 107 by using 
the function (box 412) of a copy management module 
402 in the master control unit 105 (step 450). 
[0041] Subsequently, a pair is defined by the informa- 
tion processor 1 00 or service processor 1 08, transferred 
to the master control unit 105, and registered into a con- 
sistency time group control block 310 in the control 
memory 1 07 by using the function (box 41 4) of the mas- 
ter control unit 1 05 in the copy management module 402 
(step 452). In this case, the information is also reflected 
in the remote control unit 115 via a remote communica- 
tion module 403 (step 480). The master control unit 105 
waits for the response (step 482). 
[0042] Subsequently, when a write request 454 is is- 
sued from the information processor 100 to each of the 
pairs defined, write data is received by a write data con- 
trol module 401 in the master control unit 1 05 and stored 
into the cache memory 106, that is, temporarily stored 
(step 460). 

[0043] A control area of the write data on the control 
memory 1 07 is acquired, a cache address 303, write po- 
sitions 301 and 302 on logical and physical devices, 
write data length 304, sequential number 305, times- 
tamp 306 to be added to the write data, and copy pend- 
ing information 307 are set to "ON* (step 462), and a 
write completion report is sent to the information proc- 
essor 100 (step 464). 

[0044] Then the latest timestamp 337 of the consist- 
ency time group control block 310 on the control mem- 
ory 107 is set and the difference between the latest 
timestamp 337 and the oldest timestamp 336 in write 
data whose copy pending information flag is "ON" is ob- 
tained (step 466). 

[0045] The difference obtained in step 466 is com- 
pared with the copy pending allowance time 335 (step 
468). When it is within the allowance time, the process 
of the write data control module is finished. 
[0046] After that, in a certain period or at a timing 
when a predetermined amount of copy data is generat- 
ed, a copy data transfer module 404 is called to transfer 
the copy data to the remote control unit 115 in accord- 
ance with the order of the sequential numbers 305 of 
the write requests asynchronously with the write request 
(step 490). A report of the copy data reception from the 
remote control unit 115 is waited (step 492). The copy 
pending information 307 with respect to the write data 
is set to OFF upon receipt of the reception report in step 
492 (step 494). With reference to the consistency time 
group control block 310 in the control memory 107, the 
oldest timestamp 336 in the pending data is obtained 
and updated (step 496). 

[0047] In the case where there is no pending data, 
when a new write request is sent to the control group, 



timestamp to be added to the write data is set. 
[0048] On the other hand, when the difference ex- 
ceeds the allowance time in step 468, in order to sus- 
pend copying of data to the control group, that is, the 

5 remote control unit 1 1 5 (step 470), the remote commu- 
nication module 403 is called and a copy suspension 
report with respect to the control group is sent to the 
remote control unit 115 (step 484), and a reception re- 
port from the remote control unit 115 is waited (step 

io 486). 

[0049] Upon receipt of the receipt report of step 486, 
the copy management module 402 is called and the pair 
status 333 of each of ail of the pairs 334 registered in 
the consistency time group control block 310 is set to 

15 be "suspended" (box 416). 

[0050J In the case of suspension, the user is request- 
ed to change the setting by requesting the user to 
change an amount of requests from the information 
processor 100 to the master control unit or to change 

20 the copy pending time 335 so that the difference be- 
tween the latest timestamp 337 and the oldest times- 
tamp 336 does not exceed the copy pending time 335. 
After that, a copy which is consistent on both of the mas- 
ter and remote sides is created and an operation from 

25 the first stage as described above, that is, a normal op- 
eration is restarted. Since the recovering method after 
suspension is similar to the case where the copying is 
suspended for other reasons, its description is omitted 
here. 

30 [0051] It is also possible to obtain a difference be- 
tween the latest timestamp 337 and the consistency . 
time obtained lately from the remote control unit 115 in 
step 484 of the remote communication module 403, that 
is, the consistency time 338 in the consistency time 

35 group detail information 330 of the corresponding group 
and to compare the difference with the copy pending al- 
lowance time. 

[0052] Further, the embodiment can be applied as it 
is to a system comprising a plurality of master control 

40 units 105 and a plurality of remote control units 115. 
[0053] A second embodiment will now be described. 
In the second embodiment, the copy pending allowance 
is determined in the remote control unit 115. 
[0054] Fig. 5 schematically shows the second embod- 

45 iment. 

[0055] Fig. 5 is comprised of a plurality of master con- 
trol units 1 05 and a plurality of remote control units 115. 
[0056] Particularly, in the embodiment, the remote 
control unit 115 which controls the consistency time is 

50 called a master and the other control units are called 
slaves. That is, all of copy data is sent from the master > 
control unit to the master. The master controls the con- 
sistency time with respect to all of the sent copy data. 
When the remote control unit to which the data is copied 

55 at last is a slave, the copy data is sent to the slave. The 
slave does not control the consistency time. 
[0057] Fig. 5 shows a configuration example in which 
all of the copy data is sent to the master. A configuration 
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of sending the copy data to the slave as an inherent copy 
destination and sending the write time directly from the 
master control unit or from the slave to the master may 
be also used. 

[0058] When the remote control unit 115 serving as 
the master receives the copy data sent from the master 
control unit 105, the write data control module 501 
stores it as non-reflected data into the cache memory 
106 in the master (step 560). 

[0059] Subsequently, an area of the write data control 
block 300 for controlling the non-reflected data is as- 
sured by the control memory 1 07. Addresses of the copy 
data in the disk units 110 are set as write addresses 301 
and 302 and an address on the cache memory in which 
the non-reflected data is stored is set as the cache ad- 
dress 303. 

[0060] Simultaneously, the write data length 304 is set 
and sequential number and write time to be transferred 
with the data are set in the areas 305 and 306, respec- 
tively. 

[0061] The non-reflected data flag is set in the area 
307 (step 562). 

[0062] In the invention, it is also possible not to pro- 
vide the non-reflected data flag. The non-reflected data 
may be collected in a specific memory area or controlled 
in a queue state. 

[0063] When the write data control block 300 in the 
non-reflected data is determined, the master remote 
control unit 115 reports the receipt to the master control 
unit 105 (step 564). 

[0064] After that, as the latest timestamp in the non- 
reflected data, the timestamp of the copy data is regis- 
tered as the latest timestamp 337 in the consistency 
time group detail information 330 on the remote side 
with respect to the corresponding control group (step 
566). 

[0065] The consistency determining module 503 
properly determines the consistency time in a certain cy- 
cle and updates the area 338 (area in the remote control 
unit 1 1 5 which serves as the master) in the consistency 
time group detail information (step 568). 
[0066] A non-reflected data attribute is changed to a 
consistency data attribute by, for example, resetting the 
non-reflected data flag to the data whose consistency 
has been lately assured in step 568 (step 570). 
[0067] After that, a difference between the latest 
timestamp 337 for each control group and the latest data 
consistency time 338 is obtained and compared with the 
copy pending allowance time 335 (step 572). 
[0068] The information in the area 335 is supplied in 
advance via the information processor 100 or service 
processor 108 on the master side or the information 
processor 100 or service processor 108 connected on 
the remote side. 

[0069] When the difference exceeds the designated 
allowance time, the copying process to the control group 
is suspended or regulated (step 574). 
[0070] Specifically, in the case of regulation, the copy 



data from the master side is refused or regulated (step 
576). Especially, in the case of suspending the copying 
process, the pair belonging to the control group on the 
remote side and the states of the control groups (areas 
s 333 and 322) are switched to the "suspended" status 
(step 578). 

[0071] Simultaneously, the status change on the re- 
mote side is notified to each of the master control units 
105 including the control group by an interruption noti- 
fy fication or the like (step 580). 

[0072] In the embodiment, as shown in Fig. 6, the lat- 
est timestamp 337 is periodically transferred from the 
master control unit separately from the write data or the 
latest timestamp 337 on the master control side is added 
is to the write data and transferred (box 650), thereby en- 
abling the copy pending allowance time to be assured 
more strictly. Alternately, in combination with the first 
embodiment, the copy pending allowance time on the 
; master side and that on the remote side are added and 
20. the sum is used as copy pending allowance time. The 
copy pending allowance time obtained from the latest 
timestamp of the latest write data written in the master 
control unit 105 and the consistency time can be as- 
sured more strictly. 
25 [0073] A third embodiment will be described herein- 
below. 

[0074] Fig. 7 schematically shows the third embodi- 
ment. 

[0075] Since the flow of the processes of the third em- 
30 bodiment is basically similar to that of the first embodi- 
ment, its detailed description of the flow of processes is 
omitted here and only different points will be described. 
[0076] In the embodiment, the timestamp is not used 
but the number of write requests is used as a unit. When 
35 data on a certain number of requests remains, the cop- 
ying process of the control group is suspended or reg- 
ulated. 

[0077] Thus, the problem to be solved by the invention 
can be cleared without using the timestamp. 

40 [0078] In this case, instead of the copy pending allow- 
ance time, a copy pending allowance number threshold 
(one data write request is calculated as once) is set in 
the area 335 in the consistency time group detail infor- 
mation 330 and the number of data which is not copied 

45 to the remote side is set instead of the oldest timestamp 
in the area 336. 

[0079] In practice, the write data is stored in the cache 
memory, the write data control information is deter- 
mined, and the reception is reported (steps 760, 762, 

50 764). After that, the number of write pending data is 
fetched, the number of the write requests is added (step 
766), and the resultant value is compared with the copy 
pending allowance number threshold (step 768). 
[0080] When it exceeds the threshold, the copying op- 

55 eration to the control group is suspended or regulated. 
[0081] The embodiment using the copy pending al- 
lowance number threshold can be applied almost as it 
is to the second embodiment using the time as a unit. 
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[0082] As described above, the invention can assure 
and maintain the consistency of data to be stored within 
a certain range with respect to one or more control units 
having the function of asynchronously copying or com- 
pressing and storing updated data as secondary data to s 
itself or another control unit without exerting an influence 
on the response to the write request issued by the infor- 
mation processor. 

[0083] A burden on data recovery can be also sup- 
pressed without loosing the significance of the consist- 10 
ency of data. 

Claims 

15 

1 . An information storage system comprising a master 
control unit (105) for receiving a data write request 
from an information processor (100), and a storing 
unit (110) connected: to the master control unit 
(105), 20 

wherein said control unit (105) has a control 
module (401 ) for comparing the difference between 
the latest write time (337) and the oldest write time 
(336) in a group of write data which has not been 
transferred to a remote control unit (1 1 5) with a pre- 25 
set allowance time (335). 

2. An information storage system comprising a master 
control unit (105) for receiving a data write request 
from an information processor (100), and a remote oo 
control unit (115) to which the write data is trans- 
ferred from said master control unit (105), 

wherein said control unit (105) has a control 
module (401 ) for comparing the difference between 
the latest write time (337) and the oldest write time 35 
(336) in a group of write data which has not been 
transferred to a remote control unit (115) with a pre- 
set allowance time (335). 

3. The system of claim 1 , wherein said control module 40 
(401) regulates a write request from said informa- 
tion processor (100) when the time difference ex- 
ceeds said allowance time (335). 

4. The system of claim 2, wherein said control module 45 
(401) regulates or suspends a data transfer to said 
remote control unit (115) when the time difference 
exceeds said allowance time (335). 

5. The system of claim 2, wherein said control module so 
(401) compares the number of data which has not 
been copied to said remote control unit (1 1 5) with a 
preset data pending allowance number instead of 
comparing the time difference between the latest 
write time (337) and the oldest write time (336) 55 
among the added write time with said preset allow- 
ance time (335). 



6. The system of claim 1 , wherein said master control 
unit (105) has a memory (107) for storing, as said 
write time, the write time included in said write re- 
quest, or the time when said information processor 
(100) receives said write request. 

7. A data transfer method of an information storage 
system comprising a master control unit (105) for 
receiving a data write request from an information 
processor (100). a storing unit (110) connected to 
the master control unit (105), a remote control unit 
(1 1 5) to which the write data is transferred from said 
master control unit (105), and a storing unit (110) 
connected to said remote control unit (1 1 5), wherein 
the master control unit (105) compares the differ- 
ence between the latest write time (337) and the 
oldest write time (336) in a group of write data which 
has not been transferred but should be transferred 
tosaid remote control unit (115) with a preset allow- 
ance time (335). 

8. The method of claim 7, wherein when the time dif- 
ference exceeds said allowance time (335), the 
write request from said information processor (100) 
is regulated. 

9. The method of claim 7, wherein when the time dif- 
ference exceeds said allowance time (335), writing 
of data to said remote control unit (11 5) is regulated 
or suspended. 

10. The method of claim 7, wherein a comparison be- 
tween the number of data which has not been cop- 
ied to said remote control unit (115) and a preset 
data pending allowance number is used instead of 
the comparison of the time difference between the 
latest time (337) and the oldest time (336) of the 
added write time with said preset allowance time 
(335). 



6 



EP 0 997 817 A2 



EC 



LU 
\— 

CO 

>- 

CO 

LU 
CD 

< 

OC 

O 
I — 

CO 



O 
< 

DC 
O 



rT -UJ 

-"1 



CO 



CO 

o 



eg 
o 



LU 
O 
< 

SCO 



o 



co 
o 



Q. 
O 



o 



CO 

o 



o 



CL 
> 
CO 



< 

CL 



< 
Q 

o 



^LU 
CL ~ 



CO 

o 



2 



5m 



LU 



o 



CO 

o 



o 

1 



CL 

o 



CO 

o 

1 



< 

o 



LU 



o 



CO 
LU 

ZD 

O 

LU 

CC 

LU 

£5 



/ 









(SHARED) 
CONTROL 
MEMORY 


TROL UNIT 






NO: 


$ 

CO 


CACHE 
MEMORY 


REMOTE C 






CO 

o 


CL 




> 




CO 




7 



EP 0 997 817 A2 



FIG. 2 

CONFIGURATION EXAMPLE OF RAID 



110 



110 



110 



201 



LOGICAL DEVICE 



201 



LOGICAL DEVICE 



8 



EP0997 817A2 



FIG. 3 

CONTROL MEMORY 107 
<CONTROL MEMORY> 



WRITE DATA 
CONTROL BLOCK 



CONSISTENCY TIME 
GROUP (CT GROUP) 
CONTROL BLOCK ^ 



CT GROUP 
INFORMATION 



CT GROUP DETAIL 
INFORMATION 




/WRITE DATA CONTROL \ 
\ BLOCK (TABLE) / 



/ ; <CT GROUP INFORM 


ATION>x\ 


CT GROUP 
NUMBER 


CT GROUP 

CONTROL 

FLAG 


CT GROUP 
STATUS 


0 


ON 


NORMAL 


1 


OFF 


NORMAL 









-322 



}321 
}321 



PHYSICAL 
ADDRESS 



CACHE 
ADDRESS 



LOGICAL -_301 
ADDRESS^ 

302 
303 
304 
305 
1-306 
307 



DATA 
LENGTH 



SEQUENTIAL 
NUMBER 



TIMESTAMP 



COPY PENDING 
INFORMATION 
FLAG/NON- 
REFLECTED DATA 
INFORMATION 
FLAG 



/CT GROUP DETAIL INFORMATION \ 
\(ONE CT GROUP) / 



GROUP # 


MASTER VOLUME 
NUMBER #331 


INFORMATION 332 ON 
REMOTE CONTROL 
UNIT SIDE 


GROUP 
STATUS 
333 


REMOTE 
CU SERIAL 
NUMBER 


REMOTE 
VOLUME 
NUMBER 


1 


00 


54321 


10 


NORMAL 


2 


i 10 J 


01234 


3F 


NORMAL 


3 


20 


54321 


20 


NORMAL 












n 











}334 
}334 
}334 

}334 



COPY PENDING (ALLOWANCE) TIME 



THE OLDEST TIMESTAMP 



THE LATEST TIMESTAMP 



CONSISTENCY TIME 



-335 
-336 
-337 
-338 



9 



EP 0 997 817 A2 



PROCESS FLOWCHART 

FICn A /ASSURANCE OF CONSISTENCY BY USING DIFFERENCE BETWEEN THE LATEST ' 
' fV *»- ^ VTIMESTAMP AND THE OLDEST TIMESTAMP IN MAS^ 



INFORMATION 
PROCESSOR 

too— 

MASTER 
CONTROL UNO* 
105 

WRITE DATA 
CONTROL 
MODULE 401 
SVP 
1 08^ 



CT GROUP 
FORMING 
INSTRUCTION 
/DESIGNATION 0F\ 
COPY PENDING 
ALLOWANCE 

vtime ; 


^-450 


. co WRITE REQUEST 

45Z AZA 

456 4 r 458 

i, f. , > i=i 


DEFINE 
GROUP 


| WRITE DATA | TIMESTAMP | 



^450 



CT GROUP 

FORMING 

INSTRUCTION 



452 



DEFINE 
GROUP 



REMOTE 

COMMUNICATION 
MODULE 
403 

X 



TRANSFER WRITE DATA TO CACHE 
MEMORY 



460 



7^ 



a/462 



OBTAIN AND SET WRITE DATA 
CONTROL INFORMATION 
/COPY PENDING INFORMATION^ 
WON, etc. ) 

\ 



464 



REPORT COMPLETION OF WRITE 
DATA RECEPTION 

I 



466 



OBTAIN COPY PENDING ALLOWANCE 
TIME AND THE OLDEST TIMESTAMP 

\ /v/468 



THE LATEST 
TIMESTAMP 337 AND 
THE OLDEST 



NO 



1 


COPY 1 


> 


PENDING 




ALLOWANCE 


i 


TIME 335 



YES 



470 



SUSPEND COPYING 
TO THE CT G ROUP 



END 



] 



^480 



TRANSFER VARIOUS 
COPY RELATED 
INFORMATION 
/TRANSFER GROUPS 
INFORMATION OF 
ICT GROUP / 



a/ 484 



ISSUE VARIOUS INSTRUCTIONS 
TO REMOTE SIDE 
• INSTRUCT SUSPENSION OF 
COPY 

: OBTAIN REMOTE SIDE 
INFORMATION etc. 



\ /^.482 J 



WAIT FOR 
ACCEPTANCE 
REPORT 



486 



WAIT FOR ACCEPTANCE 
REPORT AND DATA 
ACCEPTANC 



ENO 




COPY MANAGEMENT 
MODULE , nn 



a/412 




REGISTER 






CT GROUP 






CONTROL 






INFORMATION 




/^414 




REGISTER 






AND UPDATE 






CT GROUP 






DETAIL 






INFORMATION 






/SET COPY ) 






PENDING 






ALLOWANCE 






(time j 




a/416 




CONTROL 






STATUS OF 






CT GROUP 







REMOTE 
CONTROL 
UNIT 



COPY DATA TRANSFER MODULE 
/v/404 



a/490 



TRANSFER COPY DATA, 
TIMESTAMP, etc 



a/492 



WAIT FOR 

ACCEPTANCE REPORT 



494 



COPY PENDING 
INFORMATION 307— OFF 



496 



UPDATE THE OLDEST 
WRITE TIME 336 

r 



"end I 



10 



EP 0 997 817 A2 



_ PROCESS FLOWCHART 
FlCn n [ASSURANCE OF CONSISTENCY BY USING THE LATEST ) 
I I KJ. \J Itimestamp ON REMOTE SIDE AND CONSISTENCY TIME ) 



MASTER 

CONTROL 

UNIT 115 



SVP 



^501 



WRITE DATA CONTROL 
MODULE ^560 



TRANSFER COPY DATA TO CACHE 
MEMORY (NON-REFLECTED DATA) 



| ^562 



OBTAIN AND SET WRrTE (COPY) 
DATA CONTROL INFORMATION 
(NON-REFLECTED DATA) 



\ ^564 



REPORT OF COMPLETION OF COPY 
DATA ACCEPTANCE 



I 



/i/566 



I UPDATE THE LATEST TIMESTAMP 3371 



I 



END 



^502 



COPY 

MANAGEMENT 
MODULE 



SET REMOTE SIDE 
WRITE DATA 
CONTROL 
INFORMATION 



SET CT GROUP 

CONTROL 

INFORMATION 



DATA CONSISTENCY 
DETERMINING MODULE 
/x/503 



< DETAILS OF COPY SUSPENSK)N> 



/v/566 

UP DATE CONSISTENCY TIME 338 I 



^570 



CHANGE DATA ATTRIBUTE 
[NON-REFLECTED DATA-* 
ICONSISTENCY DETERMNED DATA, 



572 



/ DIFFERENCE BETWEEN 
CONSISTENCY TIME 338 
AND THE LATEST 
\ TIMESTAMP 337 





COPY 


> 


PENDING 


1 


TIME 335 
V / 



NO 



YES 



^574 



SUSPEND COPYING 
TO THE CT GROUP 



END 



576 



REFUSE ACCEPTANCE OF 
COPY DATA 
TV 



\ /^578 



CHANGE GROUP STATUS 

• GROUP STATUS NORMAL 
-SUSPENDED 

• CT GROUP STATUS 
NORMAL-SUSPENDED 



/^580 



NOTIFY OF CHANGE IN 
REMOTE SIDE STATUS 
[NOTIFY EACH CONTROL} 
VUNIT ON MASTER SIDE J 



COPY DATA TRANSFER MODULE 
^504 



/y/520 



(SLAVE) 



115 



(SLAVE) 



115 



TRANSFER CONSISTENCY 
DETERMINED DATA 
ATTRIBUTE DATA TO 
SLAVE 



(SLAVE) 



115 



11 



EP 0 997 817 A2 



6 



PROCESS FLOWCHART 

(assurance of consistency by using timestamp 1 
Ion master side and consistency time 




a/108 



SVP 



transfer 
the latest 
timestamp 
•periodic 
transfer 

•ADD TO 
COPY DATA 



MASTER 
CONTROL 

UN,T 115 



X 



^601 



WRITE DATA CONTROL 
MODULE £y660 



TRANSFER COPY DATA TO CACHE 
MEMORY (NON-REFLECTED DATA) 



I 



662 



OBTAIN AND SET WRITE (COPY) 
DATA CONTROL INFORMATION 
(NON-REFLECTED DAT A) 

1 



a/ 664 



REPORT OF COMPLETION OF COPY 
DATA ACCEPTANCE 

T 



666 



I UPDATE THE LATEST TIMESTAMP 3371 



END 



J 



a/602 



DATA COPY 
CONTROL MOOULE 



a/610 



SET REMOTE SIDE 
WRITE DATA 
CONTROL 
INFORMATION 



a/612 



SET CT GROUP 

CONTROL 

INFORMATION 



CONSISTENCY DETERMINING 
MODULE ^603 



< DETAILS OF COPY SUSPENSION> 



' /1/668 

I UPDATE CONSISTENCY TIME 338 I 



a/670 



CHANGE DATA ATTRIBUTE 
(NON-REFLECTED DATA- 
V CONSISTENCY DETERMINED DATA 

I 



672 



CONSISTENCY TIME 338 
AND THE LATEST 
V TIMESTAMP 337 



1 


( \ 
COPY 


> 


PENDING 


i 


TIME 335 
\ / 



NO 



YES 



a/674 



SUSPEND COPYING 
TO THE CT GROUP 



END 



REFUSE ACCEPTANCE OF 
COPY DATA 



676 



7^ 



a/678 



CHANGE GROUP STATUS 

• GROUP STATUS NORMAL 
-SUSPENDED 

• CT GROUP STATUS 
NORMAL-SUSPENDED 



| a/680 



NOTIFY OF CHANGE N 
REMOTE SIDE STATUS 
(NOTIFY EACH MASTERS 
VSIDE CONTROL UNIT ) 



COPY DATA TRANSFER UNIT 
a/604 



a^620 



TRANSFER CONSISTENCY 
DETERMINED DATA 
ATTRIBUTE DATA TO 
SLAVE 



I ci. 
(SLAVE) 



115 



(SLAVE) 



115 



(SLAVE) 



115 



12 



EP 0 997 817 A2 



FIG. 7 



PROCESS FLOWCHART 

( ASSURANCE OF CONSISTENCY BY USING THE \ 
V NUMBER OF PENDING COPY DATA j 



INFORMATION 
PROCESSOR 
100— 



MASTER 
CONTROL UNfT 
105 

WRITE DATA 
CONTROL 
MODULE 701 
SVP 
108^ 



INSTRUCT 
FORMATION OF 
CT GROUP 
/ DESIGNATE THE \ 
PERMISSIBLE 
NUMBER OF 

Ipending DATA / 


y-750 WRITE REQUEST 
^752 /v/754 


DEFINE 
GROUP 


/v/756 




WRITE DATA | 



XL 



750 



INSTRUCT 

FORMATION OF 

CT GROUP 
/DESIGNATION ' 

OF THE 

PERMISSIBLE 

NUMBER OF 
\PENDING DATA; 



XL 



752 



DEFINE 
GROUP 



REMOTE 

COMMUNICATION 
MODULE 
703 

I 



TRANSFER WRITE DATA TO CACHE 
MEMORY 



760 



7^ 



zv/762 



OBTAIN AND SET WRITE DATA 
CONTROL INFORMATION 
/"COPY PENDING INFORMATIONS 
l-ON, etc. j 



REPORT COMPLETION OF WRITE 
DATA RECEPTION 

I 



OBTAIN AND UPDATE THE NUMBER 
OF REMAINING COPY PENDING DATA 



I 



0F\ /THE PERUISSRE\ 

ipy |>(numberof ? 



I THE NUMBER 
REMAINING COPY 
PENDING DATA / \PENDNG DATA 



NO 



VESJ ^770 



SUSPEND COPYING 
TO THE CT GROUP 

— I 



END 



j 



^780 



1 * 


WAIT f 
ACCEP 
REPOF 


: OR 

TANCE 

T 




1—4 



^784 



TRANSFER VARIOUS 




ISSUE VARIOUS INSTRUCTIONS 


COPY RELATED 




TO REMOTE SIDE 


INFORMATION 




• INSTRUCT SUSPENSION OF 


/TRANSFER CT \ 




COPY 


GROUP AND GROUP 




• OBTAIN REMOTE SIDE 


INFORMATION I 




INFORMATION etc. 



782 



WAIT FOR ACCEPTANCE 
REPORT AND DATA 
ACCEPTANCE 



END 




DATA COPY 
CONTROL MODULE 
/v/702 



zx/712 



REGISTER 
CT GROUP 
CONTROL 
INFORMATION 



XL 



714 



REGISTER 
AND UPDATE 
CT GROUP 
DETAIL 

INFORMATION 

/SET THE 
PERMISSIBLE 
NUMBER OF 

SPENDING DATA 



716 



CONTROL 
STATUS OF 
CT GROUP 



REMOTE 

CONTROL 

UNIT 



COPY DATA TRANSFER MODULE 
A/ 704 



XL 



790 



TRANSFER COPY DATA, 
TIMESTAMP, etc. 



XL 



792 



WATT FOR 

ACCEPTANCE REPORT 



XL 



794 



COPY PENDING 
INFORMATION 307-OFF 



I 



XL 



796 



UPDATE THE NUMBER 
OF COPY PENDING DATA 1 

■ END I 



13 



